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Abstract 

Landscape is one of the key notions in literature on biological processes and physics 
of complex systems with both deterministic and stochastic dynamics. The large devia- 
tion theory (LDT) provides a possible mathematical basis for the scientists' intuition. 
In terms of Frcidlin-WcntzeH's LDT, we discuss explicitly two issues in singularly per- 
turbed stationary diffusion processes arisen from nonlinear differential equations: (1) 
For a process whose corresponding ordinary differential equation has a stable limit 
cycle, the stationary solution exhibits a clear separation of time scales: an exponen- 
tial terms and an algebraic prefactor. The large deviation rate function attains its 
minimum zero on the entire stable limit cycle, while the leading term of the prefac- 
tor is inversely proportional to the velocity of the non-uniform periodic oscillation on 
the cycle. (2) For dynamics with multiple stable fixed points and saddles, there is in 
general a breakdown of detailed balance among the corresponding attractors. Two 
landscapes, a local and a global, arise in LDT, and a Markov jumping process with 
cycle flux emerges in the low-noise limit. A local landscape is pertinent to the transi- 
tion rates between neighboring stable fixed points; and the global landscape defines a 
nonequilibrium steady state. There would be nondiffercntiablc points in the latter for 
a stationary dynamics with cycle flux. LDT serving as the mathematical foundation 
for emergent landscapes deserves further investigations. 

Keywords: large deviations; limit cycle; multistability; nonequilibrium steady state; 
singularly perturbed diffusion process. 
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Stochastic nonlinear approaches to dynamics has attracted great interests 
from physicists, biologists, and mathematicians in current research. More 
than 70 years ago, Kramers has developed a diffusion model characterizing 
the molecular dynamics along a reaction coordinates, via a barrier crossing 
mechanism, and calculated the reaction rate for an emergent chemical reac- 
tion. The work explained the celebrated Arrhenius relation as well as Eyring's 
concept of "transition state". Kramers' theory, however, is only valid for 
stochastic dynamics in closed systems with detailed balance (i.e., a gradient 
flow), where the energy landscape gives the equilibrium stationary distribu- 
tion via Boltzmann's law. It is not suitable for models of open systems. Limit 
cycle oscillation is one of the most important emergent behaviors of nonlinear, 
non-gradient systems. The large deviation theory from probability naturally 
provides a basis for the concept of a "landscape" in a deterministic nonlinear, 
non-gradient dynamics. In the present study, we initiate a line of studies on 
the dynamics of and emergent landscape in open systems. In particular, using 
singularly perturbed diffusion on a circle as a model, we study systems with 
stable limit cycle as well as systems with multiple attractors with nonzero flux. 
A seeming paradox concerning emergent landscape for limit cycle is resolved; 
a local theory for transitions between two adjacent attractors, a la Kramers, 
is discussed; and a "A-surgery" to obtain nonequilibrium steady state (NESS) 
landscape for multiple attractors is described. 

1 Introduction 

Stochastic nonlinear dynamics (SND) of biochemical reaction systems at the cellular and 
subcellular level has received much interests in recent years from applied mathematicians, 
physicists, as well as biologists [27J. In terms of stochastic processes, the main mathe- 
matical approaches to biochemical SND are either diffusion processes i.e., the chemical 
Langevin equation, or the chemical master equation |4CH [TJ [15] which characterizes the 
evolution of probability distribution for a Markov jump process that can be simulated by 
the method of Gillespie algorithm. For both stochastic models, their infinite large system 
(macroscopic) limit is a system of nonlinear ordinary differential equations (ODE) based 
on the Law of Mass Action [19\ [7] . These mathematical models have provided a unique 
opportunity for comparative studies of corresponding nonlinear dynamics in small and in 
large systems. 

In quantitative biology and in statistical physics, there is an emerging notion of "land- 
scape" for dynamics [8J, as both a metaphor and as an analytical device [41\ H5j 113] . 
Landscape for a gradient system is of course natural, and the well-known Kramers' rate 
theory directly follows [18] (Fig. [1]). For a non-gradient system, a Lyapunov function 
[25], if exists, can still be visualized as a landscape for the dynamics. The real ques- 
tion is whether there always exists such a landscape function for non-gradient system 
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and whether there is a corresponding Kramer s'-like rate formula for the inter-attractoral 
transition rates. For bistable systems, the answer to this question is yes [H [I2j [I3j [28] : 
The rate formula is exactly the same as the classical Kramers' formula (Fig. Q]). But how 
could one perceive a "landscape" for a periodically oscillatory system? Furthermore, is 
there any difference between multistable and bistable systems? These questions are the 
motivations of the present paper. 

The case of a system with a limit cycle is in defiance of the intuition [35] , and there are 
other serious, but subtle arguments against the general notion of landscape for systems 
with limit cycles. Noting that a same landscape is used for a deterministic dynamics as 
well as the stationary probability of its stochastic counterpart, one objection can be stated 
as follows: Let <p{x) be a landscape of a system with limit cycle V. Then (p(x) has to be a 
constant on T. However, since the landscape is also expected to represent the probability 
of a stochastic system: Lower corresponds to higher probability. Combining the two 
lines of reasoning, one arrives at equal probability along T. Now according to the ergodic 
theory, equal probability on T implies uniform velocity on the limit cycle. This suggests 
that only uniform rotation is compatible with the notion of a landscape |45j. 

One of the aims of the present paper is to give an explicit resolution to this seeming 
paradox. The analysis reveals a separation of time scales for stochastic dynamics and its 
deterministic limit. Indeed around a limit cycle T, the probability u e (x) ~ Co(x)e~^ x ^ € in 
which 4>{x) = along the T. The dynamics on the limiting set T, therefore, is determined 
byCo(x). 

For presenting the results, we choose to be insightful rather than thorough and rigor- 
ous. Hence we shall only discuss the problem in terms of singularly perturbed diffusion 
processes. The insights we obtain, however, are qualitatively applicable also to other 
systems, even though technically they might be much more difficult to handle. More 
precisely, we would like to carry out an analysis of the singularly perturbed stationary 
diffusion equation in the form 

V-(eV« £ (x)-« £ (x)F(x)) =0, (x€R N ). (1) 

In Eq. ([1]) e is a small positive parameter. 

For a discussion of limit cycles in the Chemical Master Equation, see |30|. 138]. and the 
diffusion approximation in general, see |35j. The singularly perturbed 2nd order linear 
elliptic equation is a well-studied problem in mathematics. However, there are still several 
important issues remaining unclear, even for the one-dimensional circle S 1 . Here we wish 
to further explicitly illustrate some of them in connection to the case of a stable limit cycle 
or multiple attractors without detailed balance, sometime using examples. There would 
be two kinds of landscapes in the case of multiple attractors: one is for the Kramers '-like 
rate formula and the other is for the global stationary distribution. In a broad sense, 
both problems are very closely related to statistical dynamics and thermodynamics of 
nonequilibrium steady state [43] [14] . 
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2 General stationary solution and WKB approximation 

We assume the function it e (x) in Eq. (pQ) to be L\ integrable throughout M. N . And we 
further assume that F(x) is sufficiently well behaved and that a stationary probability 
density exists. See [29] for appropriate conditions. It is understood that for Eq. ([1]), in 
addition to the stationary probability u e (x), the system also possesses a non-trivial flux 
vector J: 

J = u e (x)F(x) - eVu e (x), (2) 

satisfying V • J = 0. It can be shown that J = if and only if F = — VJ7 is a gradient 
system [29j . which is called detailed balance or equilibrium. In that case, there will be no 
limit cycle and in fact tt e (x) = A exp(—U (x) / e) , where A is a normalization constant. 
Now in terms of the small parameter e, let us first assume that the limit 

limelnu e (x) = -0(x) < (3) 

exists. Note that the limit </>(x) has to be zero on the entire set where u e (x) has a nontrivial 
limit. In probability theory, 4>(x) is known as the large deviation rate function [9j |4"] 152]. 
Furthermore, we also assume that the solution has the general form 

u e (x) = C e (x)e-*«/ e , (4) 

and that there exists a positive constant v such that 

lim e p C e {x) = C (x), < C (x) < +oo. (5) 

Therefore, we have the fundamental asymptotic representation 

u e (x) = (C (x) + eCi(x) + • • • ) e-*W/ e , (6) 
as in WKB theory [2] 117]. Substituting Eq. © into Eq. ([!]), we formally have 

-Cb (V0 + F) • V(f> 
e 

- (C o V 2 + 2VC • V</> + VQ) • F + C V • F - Ci(V^) 2 - C X F • V<p) 
+ e (V 2 C - CiV 2 ^ - 2VCi • - VCi • F - Ci V • P) + • • • = 0. (7) 
The leading order term in (|7|) yields 

C (V</> + F) • V(/> = 0. (8) 

Since Cq 7^ 0, this means 

F • = — (V(/>) 2 < 0. (9) 
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Eq. ([9]) shows that for the ordinary differential equation 



f = F W , (10) 

the function <^(x) has the Lyapunov property: 

d(b(x(t)) dx , . 

J?LUl = v ._ = v . F <o. (ii) 

This result was contained in [22^ [23| [32] and first explicitly reported in [10] for chemical 
master equation. 

The second-order term in Eq. ([7|) yields 

VC • + F) + Co (V 2 <p + V • F) = 0, (12) 

from which Cb(x) can be obtained. For example, if Co(x) is a constant, independent of x, 
then Eq. f)12|) implies that + F = 7 is a divergence-free vector field. Combining this 
with Eq. PJ, we have 

F = -V^ + 7, V^-7 = 0. (13) 

The vector field F thereby has an orthogonal Hodge decomposition [21] . In other words, 
if one assumes that the solution to Eq. ([1]) is in the form of e~ w<yVL ^ e , then w(pc) has to be 
a function of e except when F has orthogonal Hodge decomposition (This is indeed the 
case for Boltzmann's law with 7 = 0). The leading order expansion is also the starting 
point of several investigations carried out by Graham and coworkers [16]. By requiring an 
orthogonality condition between the gradient and the rotational parts of the decomposition 
of F(x), the existence of a smooth 0(x) is related to the complete integrability of certain 
Hamiltonian system. The Lyapunov property of <p(x) in Eq. (J9|), however, is more general. 

3 The theory of diffusion on a circle 

We now give a thorough treatment of the dynamics on the circle, which includes either 
a limit cycle or multiple fixed points. We consider the singularly perturbed, stationary 
diffusion equation on the circle 

#^{W)-/W=0, (14) 

in which U(9) is a given smooth periodic function, U(0) = U(l), with periodic boundary 
condition u(0) = u(l) |24] . and / is a given constant. The general solution is 

u{6) = A t [ e e dz e * , (15) 
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in which A e is a normalization factor. An important quantity associated with the station- 
ary process is the cycle flux 

J = eA t (l - e- f/e ) , (16) 



which generalizes the rotation number for nonlinear dynamical systems on the circle |39j. 
When / = 0, the flux J = 0. This is the case of symmetric diffusion process in the theory 
of probability |29j . 

We note that in the limit of e — > 0, by Laplace's method of integration [2J, we have 

1+9 e u -^ dz = C (9, fye u 'W e , (17) 

Je 
where 

U*{9) = sup {U(z)-fz}, (18) 

6<z<l+0 

and C is bounded. The parameter v is either ^ or 1 depending on whether the Laplace 
integral is evaluated at an interior or a boundary point of the domain. 
u(9) in Eq. (j!5p . therefore, has the form 

u(6) = AC(9jy e^ 1 , (19) 

in which 

V{9) = U*{9)-U{9) + f9 (20) 

is periodic. Fig. [2] shows one example of how U*{9) is obtained from U(9) — f9, and V{9) 
is obtained from U*{9). In general, V(9) will have points of non-differentiability. 

If the periodic V(9) is not a constant, then it reaches its global maximum at a certain 
9*. Then in the limit of e — > 0, the stationary distribution u{9) — > 5(9 — 9*). 

However, if 

/ > max U'(9), 
oe[o,i] 

then U(9) — f'9 is a monotonically decreasing function of 9. In this case, U*(9) = U(9) — f0 
and V{9) = 0! Furthermore, v = 1 and C(9,f) = l/(f - U'{9)). Thus in the limit of 
e — > 0, we have 

1 dz v 1 1 



" (9) nioOT)J T^w (21) 

Thus, the stationary distribution u(9) reflects the non-uniform velocity on the circle 
in accordance with ergodic theory. The nature of a stable limit cycle being an attractor, 
however, is reflected by the constant (f>(x) on the limit cycle, which has a dynamics on a 
different time scale when e is small. 
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3.1 A simple example of diffusion on a circle 

We now give a simple example: A nonlinear dynamics on a circle 9 = f — sin(2-7r#) 
The corresponding Eq. CH]) has a U{9) = -l/(2vr) cos(2vr6»), 9 G §[0,1]. For / < 1, the 
deterministic dynamics has a stable fixed point at 9* and unstable fixed point at ^ — 9*, 
where we denote 9* = ^ arcsin/, 9* G [0, ^] . But for / > 1, it has no fixed point; instead 
it has a limit cycle. With periodic boundary condition, the stationary solution to Eq. (|14|) 
is Eq. (|15p in the form of 

-1+6 



(22) 



in which 



It is easy to show that when / > 1, 1/(2tt) cos(27rz) + fz is a monotonically increasing 
function of z. Hence applying Laplace's method near z = 9 one has [2] 



noW = hm o n^) = / _ s / . 2 n(2 ^ ) , 



(/>!)■ 



(23) 



This is the case with deterministic limit cycle. According to the ergodic theory, uq{9) oc 
When / < 1, one again applies Laplace's method. We introduce 9, which satisfies 



1 fo a\ _i to cos(2tt9* 
— cos(2™) + j 9 = - 
2tt 



2vr 



/(1/2-n 



If (9 e [0, | - 0*] , then one has 



« e (0) « A e exp 



1 

- < 

e 



< < 



cos(2vr0) + cos(2vr0* 
2^ 



+ / + 



< < 



< 1 



If 9 g [-i + 0*, 0] , then we denote 9 = 1 + 9 £ [| + 0*, l] . Then we have 



(24) 



ii e (0) w j4 £ exp 



cos(2vr0) + cos(2vr0* 
2^ 



cos(2vr0) + cos(2vr0* 
2^ 



+ / <? + 



+ f[e + 



< < ± 



r <9 < 



< 9 < 1 



(25) 
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Note that both Eqs. (|24p and (|25p are periodic function of 9 on [0,1]. The exponents 
in both are non-negative with a "flat region" of zero as V(9) illustrated in Fig. [2p. 
Furthermore, the maximum of V(9) is located at 9* , the stable fixed point of the nonlinear 
dynamics. Therefore, the normalized uq{9) = 5(9 — 9*) for / < 1. 
Note that the limit of Eq. ([23]) 

lim - ~ j-r =5(9-\\ (26) 
/->!+ / - sin(2vr0) V V V ' 

This simple example has been discussed widely in the nonlinear dynamic literature on 
synchronization and neural networks [Mj. As expected for the attractor of a nonlinear 
dynamics with limit cycle, the law of large numbers for the corresponding stationary 
process is not a set of Dirac-delta measures, but a continuous one. Fig. [3] shows uq(9) in 
Eq. (I23D for several different values of /. 

4 General derivation for high dimensional systems with a 
Limit Cycle 

The existence of limit cycles is indicative of a system being far from equilibrium (detailed 
balance). It has been widely believed that systems with limit cycle can not have a Lya- 
punov function. This is certainly true according to the strict definition of a Lyapunov 
function [25] . However, in a broader sense, functions with Lyapunov properties can be 
constructed for systems with limit cycle. We shall now consider a multi-dimensional F(x) 
and its corresponding 0(x), as defined above. 

First, we observe that the Lyapunov property of <f> immediately leads to the conclusion 
that </>(x) = constant if x G T, where T is a limit cycle of F. To show this, we simply note 
that 

• d£ = 0, (27) 



where the integrand 



V<P-di=^;Z de <V- (28) 



Hence, V<^(x) = 0, i.e., 0(x) = const, where x £ T. Moreover in any small neighborhood 
of r, 4>(x) must be all greater or less than that on T in the cases of stable or unstable limit 
cycles respectively. Here we do not consider the very complicated case such as strange 
attractor. 

We now compute Co(x) on T. First of all, according to Eq. (I12|) and V0(x) = on 
x 6 r, we have 

VC • F + C V • F = 0, 

i.e. V • (CqF) = 0. Then we could pick any continuous segment of T, and consider its 
(5-thickness neighborhood. When S tends to zero, the only fluxes remain are the influx 
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and outflux of the vector field CoF along T, hence according to Gauss' theorem, the 
values of the function CoF at the two ends of the segment must be the same. Therefore, 
1 1 C F 1 1 = Co||F|| must be constant along T. 

Now we restrict the dynamics to T and introduce an specific angular variable 9, 9 £ 
S: 9 is just the arc length starting from some fixed point on T. In this case, we have 

Then let ^ 

9(9) = Fi(x(0)) ( ^f) =\\F\\, i = l,2,-..,N, (29) 



x d9 , 

where x(0) = (xi(6>), x 2 (#), • • • ,x^(9)) and 



such that the differential equation on the limit cycle T becomes 

|-e W . (30) 

Hence 

om = 4), pi) 

where A is a normalization constant, whose meaning is very clear: According to ergodic 
theory, the stationary probability distribution of 9 is simply the inverse of the angular 
velocity. In fact, the period of the limit cycle is 

(32) 







Q(9) 



This corresponds to the flux on T, i.e, the number of cycles per unit time, according to 
Eq. ©: 

2 - d9 ^ 



'- A -U W)) ' (33) 

J is also known as the rotation number in nonlinear dynamics. 

We shall note that while <^(x) has the Lyapunov property, the stationary probability 
in Eq. ([6]) does not. The stationary u e (x) can not be a Lyapunov function since in general 
it is not a constant on T due to the contribution from Co(x) [45J. 

If one chooses another angular parameter 9', then the reciprocal of the velocity 0(9') 
will not be Cq. It is straightforward to modify the analysis presented above. 
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4.1 Beyond limit cycle 

The discussion in this section is only heuristic; a more detailed mathematical analysis 
remains to be developed. From the result above, it seems reasonable that for a high- 
dimensional nonlinear ordinary differential equation with vector field F(x), its entire center 
manifold has a constant <^>(x), if it exists. Similarly, </>(x) will be a constant on an invariant 
torus, i.e., quasi-periodic motion occurs. This is easy to illustrate from the simple example: 



d6 = 6 dt + V2e£>i dBf>, (34a) 
d£ = Edt + ^/2eD 2 dBf\ (34b) 

in which (#,£) G S 2 . When 0/E is irrational, the entire 8 2 is an invariant torus. However, 
the stationary probability for Eq. (|34p is separable in 6 and £. Hence according to the 
above results on the limit cycle, 4>(0,£) is constant on the entire 8 2 . 

5 Local and global landscapes in the case of multiple attrac- 
tors and emergent nonequilibrium steady state 

Nonlinear dynamics on a circle, i.e., Eq. (|14j) . can only be one of the three types: (a) 
single stable fixed point (attractor), (6) multiple stable fixed points (attractors), and (c) 
oscillation. Our focus so far has been mainly on (c), and transition from (a/b) to (c). 
However, even within (a) and (6), there are further distinctions between gradient systems 
with / = and non-gradient system with / ^ 0. The latter is known as irreversible 
diffusion processes [IB]- To complete the analysis, we now consider (b). For small e, 
the dynamics exhibits two different time scales: intra-attractoral dynamics and inter- 
attractoral dynamics. The major questions here are (i) the relative stability of these 
attractors and (ii) the transition rates between different attractors. Note the unique 
feature of dynamics on the circle S, which is different from one-dimensional R, is the 
possibility of non-gradient, i.e., no detailed balance. Stationary, reversible diffusion process 
on R has a single global landscape which simultaneously provides answers to both (i), 
e.g., Boltzmann's law, and (ii) via Kramers' theory [18 } 112 1 fT3] . This is not the case for 
stationary diffusion process on S. Although the fundamental theorems by Freidlin and 
Wentzell have been developed for quite a long time |9j, their relation to nonequilibrium 
thermodynamics is still unknown. The present study, thus, serves an initiation for this 
interesting problem. 

According to Freidlin and Wentzell [9], in the high-dimensional case as well as in the 
one-dimensional compact manifold, there are two types of landscapes: The local landscape 
underlies a Kramers' theory- like analysis for a single transition from one basin of attrac- 
tion to another. The global landscape, on the other hand, is for the relative stability in 
nonequilibrium steady state |43t 114] . The well-known Kramers' rate theory states that 
[18^ [TT] the barrier crossing time is exponentially dependent on the barrier height and 
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nearly exponential distributed [3] when the noise strength tends to zero. Then, putting 
together all the transition rate constants computed from the Kramers' theory, one ob- 
tains a discrete-state continuous-time Markovian chain (In chemistry, this is called discrete 
chemical kinetics.). According to a key theorem in [33], one could then realize that such a 
Markov chain is equilibrium if and only if the local landscapes derived from the Freidlin- 
Wentzell local actions in each attractive domain could be continuously pieced together; 
The function pieced together is just the global landscape; this could only be guaranteed 
with the detailed balance condition. 

Next, for each single domain (or basin) of attraction associated with a stable fixed 
point, applying the large deviation theory of Freidlin and Wentzell, one builds a local 
landscape <j>i(x), i = 1, 2, N. And then for each pair of neighbouring attractive domains 
fij and one obtains a pair of local transition rates from Kramers' theory: the transition 
rate kij from Oj to flj is proportional to e~ v ^^ e , where V(i,j) is the lowest barrier height 
of 4>i(x) along the boundary with the attractive domain Qj. 

This way, we obtain an emergent, discrete-state Markov network with state space 
{1, 2, N} and transition rates K = {/nj}jv X 7V for non-diagonal elements. The diagonal 
elements of K are determined by requiring all its rows summed to zero. A stationary 
distribution can then be solved, with ir = {-Ki} satisfying 

ttK = 0, 

Now we are ready for a cricial step: to paste (reshuffle) the local landscapes together in 
order to build the global one. The reshuffle procedure is somewhat subtle. There is an 
illustrative example in [9\ (also see Fig. 2]). Here we give a simple demonstration in terms 
of a 3-state Markov chain. 



In this case, we have 



7Tl 



7T2 



7T 3 



^23^31 + &31&21 + k 2 lk 



32 



V 

^31^12 + fcl2^32 + ^32^13 

V 

&12&23 + &23&13 + ^13^21 



V 

in which the denominator T> is determined by iri + 7T2 + 7T3 = 1. 
When e tends to zero, let 

Wi = - lim elogvri =min{y(2,3) + F(3,1),F(3,1) +F(2,l),y(2,l) +1/(3,2)}, 
W 2 = - lim elogvr 2 = min{V(3, 1) + V(l, 2), F(l, 2) + V(3, 2), F (3, 2) + V(1,3)}, 

e— >oo 

W 3 = - lim e log vr 3 = min{y(l, 2) + V(2, 3), V(2, 3) + V(l, 3), V(l, 3) + V(2, 1)}. 
So the reshuffle rule is as follows 

W(x) = mm{W 1 + V(l, x), W 2 + V(2, x), W 3 + V(3, x)}, 
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where V(i, x) means the minimum of the Freidlin-Wentzell action along the path between 
the i-th attractive domain and the position x. The intuitive understanding is that starting 
from each attractor, and compare their probabilities for arriving at x. 

In the case of three states, for instance, if x is in the first attractive domain, then 
V(l, x) = 4>i{x), V(2, x) = V(2, 1) if the backward trajectory starting from x would arrive 
at the boundary between the first and second attractive domains, otherwise V(2, x) = 
V(2, 1) + (j>i(x); V(3, x) = V(3, 1) if the backward trajectory starting from x would arrive 
at the boundary between the first and third attractive domains, otherwise V(3, x) = 

Hence, W(x) is continuous, and the global invariant distribution 

U(x) OC e -(W(*)-min<{Wi})/e. ^ 

So W(x) — minjjWj} is the global landscape, which also satisfies the Lyapunov property. 

Furthermore, we know that the emergent Markovian chain is in equilibrium, if and 
only if k 12 k 23 k 31 = k 21 k 32 k 13 02], which means V(l,2) + V(2,3) + V(3, 1) = V(2, 1) + 
V(3, 2) + V(l, 3), i.e. W 2 - W x = V(l, 2) - V{2, 1), W 3 - W 2 = V(2, 3) - V(3, 2) and 
W\ — W 3 = V(3, 1) — V(l,3). Hence the local landscape (fti(x) would be continuously 
connected at the boundaries in this case. 

The above result is a generalization of the celebrated work of Kramers [18J. In Kramers' 
theory, the underlined nonlinear diffusion process is the atomic dynamics along the reac- 
tion coordinate, while the emergent discrete dynamics is exactly the discrete chemical 
kinetics. For systems with detailed balance, Kramers' rate constants are consistent with 
Boltzmann's law for conformational probabilities. However, when detailed balance are 
not satisfied, we have clearly demonstrated here an essential difference between local and 
global landscapes: The former is related to individual state-to-state transition, while the 
latter is associated with a systems' long-time dynamics. Their disagreement is the origin 
of nonequilibrium steady states [l3j [HJ [26] . 

6 Conclusions 

Multi-dimensional diffusion processes and Markov jump processes with chemical master 
equations are two mathematical models for studying mesoscopic, nonequilibrium physical 
and biochemical dynamics with multiscale phenomena and emergent organizations |27j . 
In the past, our understandings of dynamics in terms of its molecular constituents have 
been mainly derived from theories of macroscopic, deterministic dynamics in the thermo- 
dynamic limit [19] or statistical mechanics of closed systems which are necessarily equi- 
librium. Much to be learned from the two types of stochastic models for the mesoscopic 
dynamics in open systems, especially the relationship between their asymptotic dynamics 
and emergent nonequilibirum steady state. Even for the simplest case of one-dimensional 
circle, there were important questions to be addressed and answered. In the present work, 
insights have been gained from applying methods of singular perturbation and the theory 
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of large deviations. It has been shown that the intuitive notion of a landscape can be 
further secured by applying the mathematical theories. 

Combining the insights with a wide range of existing applied mathematical techniques 
(see several reviews [211 E21 [Ml [22]), the study illustrated here can be further taken 
into several directions. Strengthening the tie |32j between the abstract theory of large 
deviations [9] and more applied singular perturbation techniques [21 [T71 [20] will yield 
further understandings for stochastic nonlinear dynamics (SND). In particular, the large 
deviation behavior of Delbruck-Gillespie process [27] is still poorly understood. The results 
from many previous workers synthesized in the present work also provides a glimpse of how 
to develop an alternative structural stability theory for nonlinear dynamical systems, as 
called by E.C. Zeeman many years ago [42]. One naturally wonders what eft and Co will be 
for a chemical reaction system that possesses a chaotic attractor [6] . Is there any regularity 
in the asymptotic behavior of the invariant measure for such systems [20 } [5l l31~ l I44| ? These 
are hard problems; but they are no longer impossible to conceive. 
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local minimum 1 



Figure 1: Landscape 4>(x) and related Kramers' rate theory for a bistable system. The 
local minima correspond to stable fixed points of a deterministic dynamics x = —d(j){x) / dx 
while the maximum corresponds to an unstable fixed (saddle) point. The V(l,2) and 
V(2, 1) represent the energy barriers for exiting energy wells 1 and 2, respectively. For 
very small e, the stationary probability distribution for stochastic dynamics with Brownian 
motion B(t), dx = —(dcj){x)/dx)dt + \f 7 le dB(t), is u e (x) oc exp ( — 4>(x)/e). The Kramers 
theory yields transition rates between the two attractors: k±2 oc e~ v ^' 2 ^ e and &2i oc 
e -V(2,i)/^ According to Freidlin-Wentzell's LDT, this theory still applies for every pair of 
neighbouring attractors of a non-gradient system in terms of a local landscape. However, 
the stationary probability distribution follows a different, global landscape. Also see Fig. 

m 
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Figure 2: (A) The thin solid line is U(9) — f9, where / is represented by the slope of the 
dashed line. The thick solid line is U*{9) = sup a6 w {U(z) — fz}. When combining 
U*{9) with —U(9) + fd, as shown in (B), one obtains V(9) given in (C). V{9) is periodic 
but contains non-differentiable points. If U(9) — f9 is monotonically decreasing, then 
U*{9) = U{9) - f9 and V{9) = 0. 
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Figure 3: The limiting distribution uq(9) according to Eq. (|23|) for nonlinear dynamics 
on a circle 9 = f — sin(27r#), with / = 5, 2, 1.1 and 1.05. With / — > 1 + , it approaches to 
5(9 - 0.25). For / < 1, the distribution is 6(9 - 9*) where 9* = 1/(2tt) arcsin(/). 
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7^2 2 3 3^7 




Figure 4: (a) Pairwise local landscapes; (b) A simple "pasting together" leads to discontin- 
uous matched case; (c) The global landscape is obtained by a "A-surgery and pasting" pro- 
cedure: The surgery lifts the well-2 with respect to well-1 an amount of In(7rifci2)/(7r2&2i)) 
which is precisely the free energy difference A//12 for well-2 with respect to well-1 in 
nonequilibrium steady state [43j. Similarly it lifts the amount of A/i23 = ^i^^^z) / {^2^2) 
for well-3 with respect to well-2, and A^3i = ln(7T3fc3i)/(7rifci3) for well-1 with respect to 
well-3. Therefore, the total lift is A/ix2 + A^23 + A^3i = ln^^A^s/csiV^iA^fcis); (d) 
The final global landscape. Note that —V(x) in Fig. [2)C is just one example of such a 
global landscape. It is a piecewise smooth function with "flat regions" at its local maxima. 
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